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Abstract. Since their inception about a decade ago, dynamic networks which adapt 
to the state of the nodes have attracted much attention. One simple case of such 
an adaptive dynamics is a model of social networks in which individuals are typically 
comfortable with a certain number of contacts, i.e., preferred degrees. This paper 
is partly a review of earlier work of single homogeneous systems and ones with two 
interacting networks, and partly a presentation of some new results. In general, the 
dynamics does not obey detailed balance and the stationary distributions are not 
known analytically. A particular limit of the latter is a system of extreme introverts and 
extroverts - the XIE model. Remarkably, in this case, the detailed balance condition 
is satisfied, the exact distribution and an effective Hamiltonian can be found explicitly. 
Further, the model exhibits a phase transition in which the total number of links 
in the system - a macroscopically interesting quantity, displays an extreme Thouless 
effect. We show that in the limit of large populations and away from the transition, 
the model reduces to one with non-interacting agents of the majority subgroup. We 
determine the nature of fluctuations near the transition. We also introduce variants 
of the model where the agents show preferential attachment or detachment. There 
are significant changes to the degree distributions in the steady state, some of which 
can be understood by theoretical arguments and some remain to be explored. Many 
intriguing questions are posed, providing some food for thought and avenues for future 
research. 
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1. Introduction 

Social networks are common in nature and show a fascinating variety of complex, 
collective behaviors. They occur in systems that range from the microscopic to the 
gigantic, e.g., quorum sensing bacteria [T], colonies of ants [2], starling murmurations 
[3], and whale pods |1]. Often, the ‘bonds’ between individuals are not directly 
observable, and so properties of the ‘network’ must be inferred from the correlated 
behavior of individuals. Thus, understanding the properties of social networks poses 
serious challenges. Among all such networks, human social networks are arguably the 
most complex. To describe them adequately and appropriately is already extremely 
difficult, let alone understanding them and predicting their evolution 

In this effort, the study of simple models that show some collective effects can be 
quite instructive. This is also a prerequisite for tackling more complex and realistic 
models. In this spirit, this article is devoted to a simple model of a dynamic social 
network which incorporates the notion that a person tends to add (cut) contacts when 
they have fewer (more) than they would like to have. For simplicity, we will model this 
tendency by assigning a number to each node, k, the preferred degree. Of course, k can 
vary from one individual to another and also, from time to time. The value of k may be 
determined internally or imposed externally. Examples of the former include introverts 
who prefer few friends vs. extroverts who prefer many, while medical quarantine is a 
good example of the latter. Incorporating some randomness in the actions of individuals, 
the network would undergo a stochastic evolution. What are the statistical properties 
of such a network (e.g., degree distribution)? Are they mundane? or surprising? Are 
some properties more robust, independent of details of evolution rules, similar to the 
universality seen in equilibrium phase transitions? 

As a hrst step, we consider the behavior of a homogeneous population, in which 
everyone has the same, time-independent k. Obviously, the general population is more 
diverse, characterized by a distribution of ks, and with some variability in time. Thus, 
our next step is to introduce diversity in the simplest way: each individual, or agent, 
has one of two ks. For such a system, we may refer to the two subgroups as ‘introverts’ 
(/) and ‘extroverts’ {E) with kj < ke. Even in this simple model, there are very many 
ways to couple the two ‘communities’ together. What can we learn from the different 
ways one subculture interacts with another? In the rest of this article, we will describe 
a number of reasonably realistic scenarios, though we will study in detail only a few. 
Not surprisingly, some aspects of the collective behavior, hrst seen in simulations, can 
be understood with hindsight, while others may appear to be counter-intuitive and 
are quite difficult to analyze. Once a few baselines are established and understood, 
generalizations can be incorporated and more complex models can be investigated. 

Though we will focus only on the properties of a huctuating network in which the 
nodes have no degrees of freedom, realistic and interesting social structures can consist 
of nodes with their own variables, e.g., health, wealth, and opinion. Frequently, these 
degrees of freedom feed back to the dynamics of the network. For example, a sick 
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individual is more likely to stay home and so, have fewer contacts than when he/she 
recovers. We can model such situations by letting n be dependent on the state of 
the person. Alternatively, a healthy individual may prefer to stay home when he/she 
learns of an ongoing epidemic in the community. In this case, we let k depend on 
the state of the whole population [S]. Such, so-called, adaptive networks, in which the 
nodes and the links ‘co-evolve,’ describe many important biological and social systems 
[HI 0 El El Uni E]. Here, we will restrict ourselves to systems with ‘static nodes and 
dynamic links.’ In this vein, we should mention that, in theoretical condensed matter 
physics, conventional studies deal with ‘dynamic nodes and static links.’ For example, in 
the textbook Ising model, the network that specihes the interactions is hxed (typically, 
a regular lattice in some dimension). Even in theories of strongly correlated electrons, 
the interactions between them do not fluctuate randomly as a function of the state of 
the electrons. 

The outline of the paper is as follows: Section 2 is devoted to a brief review, 
highlighting the more surprising aspects of our discoveries in [121 ESI EH EH EH EH EH] ■ 
This review, including the material in Appendix A, is designed pedagogically for students 
and non-experts, exposing the basic formulation of dynamic networks, as well as certain 
principal characteristics of the non-equilibrium stationary states they settle into. For 
completeness, we hrst provide detailed descriptions of the dynamics of networks with 
preferred degree and the master equation associated with the stochastic process. These 
involve a baseline model (a homogeneous population), as well as somewhat more realistic 
systems with two subgroups, interacting via a variety of ways. Discovered through 
simulations, much of the statistical properties of various degree distributions (a standard 
observable associated with networks) can be understood through simple arguments and 
mean-held approaches. In this effort, the study of a particular limiting case of the above 
has been particularly rewarding. Consisting of extreme introverts and e^xtroverts who 
prefer contact with no one and everyone, respectively, it has been called the XIE model. 
For this special, analytically tractable limit, we found the exact stationary distribution, 
as well as good approximations for most degree distributions. More signihcantly, this 
system exhibits the characteristics of both a hrst and second order transition. Known 
as the Thouless ehect [2HI EH El] , which has been observed only in equilibrium systems 
[321 EH EH EH EH EH EH], the order parameter suhers a discontinuity across the 
transition and displays anomalously large huctuations. Indeed, our system shown an 
extreme form of this ehect [IHEH, as our equivalent of the magnetisation jumps from —1 
to 1, while wandering over the entire interval [—1,1] at the transition. In Section 3, we 
show that, in the limit of large number of agents {N) and away from phase transitions, 
the XIE model becomes exactly soluble, as the agents in the majority become ehectively 
independent, with residual interactions vanishing as We also provide a scaling 

theory for the huctuations in a certain neighborhood, or scaling window, of the critical 
point. In section 4, we introduce two variants of the XIE model, where the agents are 
more selective with which links to add or cut. Novel behavior of the steady states are 
discovered through simulations, some of which can be understood theoretically. We end 
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2. Dynamic networks with preferred degrees: a brief review 

In all the models described in this article, we consider a population of N individuals 
(labelled by i = 1, each associated with a preferred degree k (i). We begin with 

systems in which the agents are not endowed with any degree of freedom, so that only 
the connections between them are dynamic - i.e., static nodes and dynamic links. The 
network, specified by an adjacency matrix A (with elements Aij = Aji = 1, 0 if nodes 
i and j are connected or not, respectively, and An = 0 to exclude self loops), evolves 
as follows: At each time step, a random agent is chosen and its degree, ki = T,jAij, is 
noted. If ki > n{i), it chooses randomly one of its links to cut. Otherwise, it adds a 
link to a randomly chosen partner not already connected to it. [|] This rule, though not 
so realistic, models the individual’s attempt to restore its degree towards the preferred 
K. Of course, we can soften this ‘rigid’ rule, by specifying smoother functions of k for 
the probabilities w± [k] k), with which the agent will add/cut a link, given that it has k 
and prefers k. However, for most of the models we study in detail, we will use the rigid 
rule, for simplicity. Thus, the total number of links in the system changes by unity at 
each time step (for 0 < k < — 1). The stochastic process of the entire network is 

described in terms of V{A,t |Ao,0), which is the probability of finding configuration A 
at time t, given an initial configuration Aq. As our main interest is in stationary states, 
we can ignore the initial state and simplify our notation to V{A, t). The rules governing 
its evolution are embodied in a discrete master equation: 

iP(A',t + l) = ^7^(A^ A')P(A,t) (1) 

A 


where TZ{A —)■ A') is the probability for configuration A to change to A'. Explicitly, TZ 

is [IS] 


E- 

N 


^ (1 “ ^'ij) + 

tAi 


0 


N-l-t 


'^ij (1 “ ^ij) 


( 2 ) 


where H = Uki^LijS (A'^^, Ake) ensures that only A^j changes (5 being the Kronecker delta) 
and 


0 = 


1 if ki > K (i) 
0 if ki < K (i) 


(3) 


is the Heaviside function, modelling the ‘rigid’ adding/cutting behavior. 

Given the explicit rates, the entire stochastic process is specified. Since these rates 
are not based on some physical process governed by a Hamiltonian, it is important to ask 
if they satisfy detailed balance or not. If they do, then the stationary distributiordi P*, 


t Note that these rules prevent the system from having an absorbing state, which would be the case if 
we let an agent with exactly k links do nothing. 

§ For a physical system in thermal equilibrium, this would be the standard Boltzmann factor. 
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can be readily constructed. Otherwise, finding V* is, in general, highly non-trivial EH- 
In our case, with neither Hamiltonian nor temperature, detailed balance can be checked 
via the Kolmogorov criterion [22]: A set of Rs satisfies detailed balance if and only if 
the product of Rs around any closed loop in configuration space is equal to that around 
the reversed loop. Since it is easy to check that this is not satisfied for some ‘elementary 
closed loops’ (i.e., the operation of adding a link a, then a link fe, then deleting a, then 
deleting b) [T3] , we conclude that despite its apparent simplicity, the model is non-trivial. 
A significant implication of detailed balance violation is the presence of non-trivial, 
stationary probability currents, K,*, even in the stationary state. As pointed out earlier 
[25] . while the (time-independent) properties of an equilibrium system are completely 
specified by the steady state distribution V*, we need to specify the pair {V*,}C*) to 
describe a non-equilibrium steady state. In Appendix A, we work out in detail the case 
of a small network with just four nodes, mainly for pedagogical purposes: examining 
every elementary loop, showing that many do not satisfy the Kolmogorov condition, 
and determining {V*,IC*) explicitly. 

On the other hand, it is simple to perform Monte Carlo simulations and to discover 
possibly interesting phenomena. For many of the quantities we study, the qualitative 
trends can be easily guessed. Apart from such ‘mundane’ results, some of these models 
do produce surprising collective behavior. Reliable approximation schemes have been 
devised, so that some of these less obvious behaviors can also be understood reasonably 
well. We discuss these below. 

2.1. Homogeneous population 

While any realistic population will display a distribution of ks, it is reasonable to begin 
with a baseline study - a system in which every agent shares the same k. In ref. [I^, we 
showed that, due to the violation of detailed balance, the stationary distribution V* (A) 
cannot be easily found. Nevertheless, every expectation is that the average degree is 
near k. Indeed, given the randomness and homogeneity in the system, a naive guess 
might be that the stationary ensemble is just the Erdos-Renyi graphs [23]. In that case, 
the degree distribution, p{k), is well known: binomial (i.e., Gaussian or Poisson, in the 
appropriate limit of large A^). 

To our surprise, from simulating a typical case with N = 1000 and k = 250, 
this system displays, to an excellent approximation, a Laplacian distribution: p{k) oc 
exp [— \k — K,\ In3]. As illustrated in Fig. 0if we ‘soften’ the updating rules to the less 
rigid w±, we find a more rounded peak at k but the exponential tails persist. These 
features can be understood through a simple argument: Consider an agent with k > k 
and the probability that its degree will increase or decrease by one in an attempt. The 
former will happen only if one of the other agents adds a link (to it). In the steady 
state, let us assume the partner is equally likely to have too many or too few links. So, 
the probability for adding is 1/2. For our individual to lose a link, the argument for 
this 1/2 also applies. But, if it is chosen, it will cut for sure. Balancing the rates for an 
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Figure 1. (a) Defining w± as w{k) and l-w{k), we use the form w{k) = (l+e“^'')/(l + 
with K = 250 in three examples: green dash-dotted line, red dashed line and 
blue solid line associated with /3 = 0.1, 0.2 and oo respectively, (b) The data points 
represent the corresponding degree distributions of a system with N = 1000. The solid 
lines are theoretical predictions, (reproduced from Ref. m)- 


agent with k links to gain or lose one, we are led to the rough estimate 




p{k + l) 


(4) 


A similar argument for k < n leads us to p{k) oc In the limit of large k, iV 

with hxed k/N < 1, this argument becomes exact. 

To understand simulation data with less rigid rules (e.g., Fig. [^), our argument 
can be repeated. In this case, the coefficients above becomes 1/2 + w+{k]tf) and 
1/2 + {k + 1;k), and the agreement with data is reasonably good, as illustrated 
in the hgure. Needless to say, as k nears the two extremes - 0 and N, the distribution 
will be distorted from a Laplacian. 


2.2. Two interacting communities: introverts and extroverts 

Proceeding to heterogeneous populations, the next simplest step is to introduce two 
subgroups (or communities, labelled by a = 1, 2 or J, i?) with various distinguishing 
properties [I6]. Obviously, the parameter space becomes 4-dimensional {Na,Ka). With 
typically unequal ks, we label the the group with smaller (larger) k introverts (extroverts). 
To model interactions between the communities, there are not only many possibilities 
but also subtle and complex issues. In this review, we will focus mainly on two variations: 
the generic {GIE) and the extreme (XIE). Though the former is more realistic, the 
latter is more tractable analytically and will be the focus of the rest of this article. As 
will be shown, even when restricted to XIE, drastically different collective behavior 
emerge when different actions on the links are introduced. In the following sections, 
we will study three variants. To distinguish them from the proto model, we will refer 
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to them as Blind, Egalitarian, and Elitist XIE models, labelled respectively by XIE^i, 
NI and NI 

Turning to the generic GIE model with two distinct communities, it is natural to 
specify an individual’s preference for cutting/adding a infra-group link vs. a cross-link 
(a link to a partner in the other group). The simplest way is to define Xo, the probability 
that an agent in subgroup a will choose a cross-link for action. To illustrate, suppose 
an introvert with degree larger than ki is chosen, then it will cut a random cross-link 
with probability xi with probability 1 — Xh ^ random link to individuals within 
the group. Clearly, y represents how likely an agent interacts with a member from the 
other community. Thus, a Xa = 0 system (initialized with Aq = 0) breaks up into two 
non-interacting, homogeneous networks. The Xa = 1 limit here is also interesting, as the 
intra-links remain absent, so that only bipartite graphs are present and the adjacency 
matrix reduces to the smaller Ni x N 2 -dimensional incidence matrix N. In either 
limit, a non-vanishing Aq can play a significant role, since the inactive sector(s) of A 
are equivalent to decreasing the effective ks of agents by different amounts. Due to 
such complications, we have not explored these limits so far. Instead, we study several 
generic points in the 6-dimensional space (Aq,, Kq, Xa)- Using Monte Carlo simulations, 
we find certain expected properties with typical xs- The degree distributions of each 
subgroup are similar to those of homogeneous populations: Laplacians around their own 
Ks. Exceptions appear when there is a large level of ‘frustration’ [16], i.e., when neither 
community can maintain link numbers close to their preferred ks. For example, with 
Xa = 1/2 say, the extroverts will find themselves creating many links with the introverts 
(roughly NeKeXe)- If NiKi is much less than this value, the introverts will struggle to 
cut these links, leading to serious ‘frustration.’ To illustrate, consider a population with 

= 5,45 and Nj^e = 10,190. The extroverts will attempt to reach 45 links each, 
with about half of them (~ 4000) directed towards just 10 introverts. Not surprisingly, 
while the extrovert majority are content, the few introverts will be overwhelmed and 
cannot achieve their preferred level of just 5 contacts. This dichotomy is well illustrated 
in Fig. . Here, pe (red triangle, pf in figure) displays the familiar Laplacian around 
ke = 45, but Pi (blue diamond, in figure) is closer to a Gaussian, peaked far 
beyond ki = 5! Remarkably, the latter depends mostly on the fact that Ni N 2 
and fairly independent of the details of the ks: Fig. & . This unexpected ‘universal’ 
feature can be explained by solving a rate balance equation in the spirit of (Q above. 
Pi (k) R {k ^ k 1) = pi {k — 1) R {k -\-1 ^ k), and making reasonable arguments to 
arrive at the transition probabilities {Rs) [T6] . 

So far we have focused on the ordinary degree distributions (p/,®) of the two 
populations. When we extend our investigations to the distributions of inter- and 
intra-links {piE, Pii, Pei, Pee), we find that they are essentially broad Gaussians, even 
when pi^E are narrow Laplacians. We illustrate this contrast for the introverts in the 
upper panel of Fig. [^[j|] This unusual combination can be understood by studying the 

II Starting with complete, empty, or random networks, we find these distributions after N Monte Carlo 
steps updates). They appear to be stable when run for a hundred times longer. That said, these 
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Figure 2. (a) The total degree distributions for a two-network model (iVi = 10, 
N 2 = 190, Ki = 5, K 2 = 45 and Xa = 0.5): pf® (blue diamonds) and p|® (red triangles), 
(b) The total degree distributions pf® for a two-network model with three different 
values of ki, K 2 . The other associated parameters are = 5, N 2 = 195, and Xa = 0.5. 
In both figures, solid lines represent theoretical predictions, (reproduced from [TO] ') 


joint distributions pa {k,, kx), the probability that an a agent has k, intra-community 
links and kx cross-links. These are related to the above ps by appropriate projections, 
e.g., pi{k) = T.k.,kx^ {k, + kx,k) Pi {k,,kx) and piE (k) = Ek.pi {k,,kx). Visualizing 
Inpo- (fc,, kx) as a landscape (Fig. lower panel), we see that it resembles a relatively 
flat half-disk (thickness much less than diameter), upended and laid along the diagonal 
k, kx = Ha- Then its profile along the diagonal appears sharp and narrow, while its 
projection onto either axis appears broad and rounded. However, though this scenario 
is adequate, we have yet to develop quantitative explanations for the partitions between 
intra- and cross-links (e.g., 150 = 50 -|- 100 for the Is in Fig. [^) and the widths of the 
Gaussians. 

Finally, we discuss one of the more unexpected features: the appearance of very 
large relaxation times in the system. Consider the most symmetric of all possibilities: 
equal {Na, Kajs and Xa = 0.5. Indeed, one might have guessed that this system 
is similar to a homogeneous population with N = 2Na- Yet, dramatic differences 
emerge. In particular, for systems with Na = 1000 and Kq, = 250, though cross¬ 
link distributions settle into Gaussians quite rapidly (starting with a null graph), the 
whole distribution wanders very slowly (while mostly maintaining the shape). Long 
simulations are required in order to study the steady state distributions in such systems 
[T^ . For convenience, we resort to much smaller networks [Na = 100, Kq = 25) in 
order to explore their properties systematically. To characterize this seemingly bizarre 
behavior, we chose to focus on a single, macroscopic quantity, X, the total number of 
cross-links between the communities. With runs up to 10^ Monte Carlo steps, we And 
that X traverses much of its expected range (up to about 2500 = Na^a), often enough for 
us to compile a reliable histogram from its time trace X (t). Of course, when normalized, 

states turn out to be quasi-stationary, as discussed later. 
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Figure 3. Top figure: The degree distributions for the introverts in a model with 
Nj = Ne = 1000, Kj = 150, ke = 250 and Xa = 0.5). The three data sets correspond 
to intra-links pu (red circle), cross-links pje (black circle), and all links pi (green 
circle). Bottom figure: Contour plot of the joint distribution, logj^p Pi {k,, fcx), showing 
the narrow sharp profile when viewed along k, = 150, and the wide Gaussians 
when projected onto either axis. White space indicates a probability of < 10“® ®. 


this histogram provides us with P{X), the probability distribution for X. Both this 
P and the power spectrum associated with X (t) displays quantitatively the anomalous 
large scale wanderings observed [16]. We found a broad plateau in P for about a third 
of the interval [0, 2500], (i.e., standard deviation of ~ 300), as well as a power spectrum 
that is consistent with that of a pure random walk, down to a lower cut-off which 

corresponds to a characteristic time for a random walker to traverse the available range 
of X. By contrast, consider a homogeneous population with N = 200, k = 25, and 
arbitrarily label half of them white and the rest black. Carrying out the simulations as 
before, we hnd the statistical properties of the total number of W-B links to be entirely 
‘normal.’ Here, the P is Gaussian, peaked around 1250 = {N/2) k with small standard 
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deviation (~ 25) which is understandable through simple arguments. Meanwhile, the 
power spectrum, being essentially constant, is consistent with that of white noise. Let 
us emphasize that difference in the rules between these two models is seemingly trivial: 
In the latter model, a W agent with k > 25 chooses to cut a random link, regardless of 
its being a W-B or W-W link. Thus, the two sets of links are correlated, in the following 
sense. Suppose there is a preponderance of W-B links, then it is more likely for one of 
those to be cut. In the interacting communities model, however, an agent first chooses, 
with equal probability, which set of links to take action. As a result, the correlation is 
lost, so that each set is equally likely to lose a link, irrespective of the preponderance 
of one set of links. We need a better understanding for how the drastic differences in 
the collective behavior can emerge from such a minor changes in the rules. This need 
also drove us to explore simpler, limiting cases which may contain similar issues. One 
of these limits is an extreme scenario ~ the XIE model. 

Before discussing the special limit, we end this subsection with some generalizations. 
Since these variants are mentioned only briefly here, we will not provide them with 
special names. Though simplest, arguably, the rule with the ys does not represent the 
most natural human behavior. For example, if we imagine two groups with opposing 
political views (e.g., right/left) and that they are rather intolerant, then a model with 
Xa 1 is not adequate: For example, when a right-winger is chosen to cut a link, it is 
much more likely for a cross-link to be cut. To model this kind of ‘dislike’, we would 
need four probabilities, Xa,+ "C 1 for adding links and Xa- — 1 for cutting. Another 
more realistic model is to introduce two sets of ks: Ka/s which controls an a agent’s 
preference for links to individuals in community (d. Thus, someone in group 1 would 
prefer to have Kh, Ki 2 intra- and inter-group links, respectively. A similar model is 
specihed by preferred ratios of intra- vs. inter-group links, modelling an agent who 
is most comfortable with having, say, 3/4 of its contacts within the group and 1/4 to 
‘strangers.’ Many simulations on these variations have been performed [H], with most 
of the results being intuitively understandable and reasonably well described by rate 
balance relations like Q. Since the dynamics in both of these models involves preferred 
‘points’ in the space of intra- and inter-link degrees, the large scale wanderings found 
above are absent. 

2.3. XIE - a model of extreme introverts and extroverts 

In an effort to gain some insight into the most surprising feature in the two communities 
model above (giant fluctuations and large scale wandering of X), we were led to ask if 
this phenomenon exists in the model at an extreme limit: kj = 0,ke = oo. Here, an 
introvert/extrovert will always cut/add a link whenever possible. Certain simplifications 
are immediately clear: In the steady state, there will be no links in the /-/ sector, while 
all links will be present in the E-E sector. The only active links will be the cross-links. 
Thus, the smaller incidence matrix N can be used to characterize the network instead of 
the larger adjacency matrix A. An element of N, denoted by riij, is 1 if the link between 
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introvert i and extrovert j is present and 0 otherwise. Thus, the XIE conhguration 
space {N} is identical to that of an Ising model (on a square lattice) with 

Af = NjNe (5) 


spins. Further, given that no more than one is ‘flipped’ in an attempt, its evolution 
resembles that in the kinetic Ising model with single-spin-flip dynamics. The major 
difference is, given fixed ks, that the only control parameters here are {Ni,Ne)- 
Meanwhile, since the probability for n to ‘flip’ from 1 to 0 is associated with an I 
being chosen, i.e., Nj/N, and similarly, Ne/N for the reverse ‘flip,’ it is natural for the 
variables 

A = Ni — Ne] h = —— ( 6 ) 

to play the role of magnetic field Now, it is clear that X = here plays the role 

of the total magnetisation in the Ising model: M = 2X — M. Thus, our interest here 
- how does the average (X) depend on (iV/, Ne) - corresponds to the Ising equation of 
state: m = (M) /M as a function of {h,T]N'). There is no obvious T in our model, and 
we will return to this question later. 

To reiterate, the rules of XIE are minimal indeed: Choose a random individual; if 
it is an J, cut one of its links at random; if it is an E, add a link to a random partner not 
already connected (to it). Most remarkably, detailed balance is restored in this limit, 
so that the stationary state can be regarded as an ordinary equilibrium one and the 
distribution V* can be easily determined. The result is [laiiii]: 


V* (N) = 



(7) 


where hi = (/cj) If (pf.) is a ‘partition function,’ ki = T^jUij is the degree of i, and 

Pj = Tjifiij [fiij = 1 — Uij) is the complement of the degree of j. We further note 
that the Ising symmetry has an analogue here: njj fiji © iV/ yy Ne , referred to 
as ‘particle-hole’ symmetry (PHS), which V* (N) clearly respects. Interpreting V as a. 
Boltzmann factor, we find an explicit Hamiltonian 

f Ni / Ne \ Ne / Nj \ ^ 

'H{N) = - < 5^1n + ^ln f 

U=1 Vj=l / j=l \i=l / } 


(with ksT = 1). Note that this Ising Hamiltonian depends on the row- and column 
sums of N. Thus, each ‘spin’ is coupled to all other ‘spins’ in its row and column, via all 
types of ‘multi-spin’ interactions. Though the appearance of long range interactions may 
suggest challenging analyses, we recall that, if an Ising Hamiltonian is only a function 
of the sum over all spins, the standard mean-field approximation becomes exact in the 
large-X limit. The case here is more complicated, as there are {Nj + Ne) different 

^ This choice of signs is for later convenience, when we focus on systems with majority of introvert 
and A > 0. 


Networks with preferred degree: A mini-review and some new results 


12 


sums, but we may expect a similar simplification in the large-iV limit. This expectation 
is realised, as we will see in the next section. 

From here, we can follow standard techniques of equilibrium statistical mechanics 
to find averages ((O) = SpjOP* (N)) of various observables, e.g., (X), P {X) = 
{S {X,T,ijnij)) and pi {k) = {6 {k,'Ejnij)), etc. In particular, we need to compute 
2 (X) /A/” — 1 to find our equation of state, m{h,J\r). Of course, such tasks are 
highly non-trivial, even when V* is explicitly given. Instead, we find that a mean- 
field like approximation scheme provides a good description. For example, replacing 
every hj x = (X) /J\f in V*, we can compute (X) for any {h,J\f). In [H], 

we presented m (h) using simulation data for various systems with N = 200, as well 
as computed from the value of X at peak of The two agree rather well, 

qualitatively. The most striking feature is the hint of an extreme Thouless effect for 
large N na eq], namely, \m\ is close to unity for non-vanishing h, so that it jumps 
from almost one extreme to the other, as h crosses the ‘critical’ value of 0. (Note that 
symmetry alone dictates m (0) = 0.) Unlike typical first order transitions, e.g., Ising 
below Tc, because of the absence of spatial structures in our model there is no phase 
coexistence, no metastability, and no hysteresis. Instead, at h = 0, the fluctuations 
are anomalously large - O (Af) instead of O ^a/AT^. This behavior is best illustrated 
by simulation data of both P (X) and the time traces of X in [TTl |T^. There, we find 
a broad, fiat plateau (over 70% of the available range of X in the N = 200 case) in 
P and X (t) performing an unbiased random walk in this range. These properties can 
be roughly understood in terms of p^^^ (X). For example, to leading order in 1/Af, 
— \nP^^^ = const. -|- Xln (Nj/Ne), so that (a) X is forced to take its extremal values 
no matter how small the two population sizes differ and (b) X can take any allowed 
value for the Nj = Ne case. In im. we studied various N G [200,3200], and found 
that indeed, as X —)■ oo, both 1 — \m{h = 0.01) | and 1 — \m{h = 2/X)| approach zero. 
However, the effective power laws, and respectively, may indicate a large 

crossover regime, the full understanding of which remains a challenge. 

Not surprisingly, similar extreme behavior is displayed in the degree distributions 
Pi,E {k) |T7]. To understand these, we proposed a MFA for their transition probabilities, 
along the lines above. In this sense, it is an approximation on the dynamics of the system, 
rather than on the static formula pi {k) = {d {k, T^jHij)). For k > 0, R{k ^ k — 1) for 
an introvert is trivially 1/X, since it always cuts a link when chosen. For R{k ^ k 1), 
we note that Ne — k extroverts can add a link to it. But we need the chances each will 
add a link to our introvert. In the spirit of MFA, the most natural estimate for this 
probability is its average: (0 (p) /p), where p is the number of ‘holes’ the extrovert has. 
We chose a slightly more convenient estimate, 1/ (p)^, where {)' is the average over only 
those extroverts with p > 0. Thus, we find a recursion relation for the approximate 


Pi {k + 1 ) 


Pi (k) 


R{k ^ k 1) 
R{k 1 ^ k) 


rsj 


NE-k 

ip)' 


Pi{k) 


(9) 


where the tilde reminds us that this is a MFA. Performing a similar treatment for the 
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Figure 4. The degree distributions for an introvert and an extrovert in a large, 
near-critical system: Ni,Ne = 1601,1599. Insets show the same points in log-linear 
plot. Theoretical predictions are shown as black lines. Data points are circles, red and 
blue for the introvert and extrovert, respectively. 


extroverts, we get approximate expressions for both steady state distributions pj^e {k). 
Now, these can be used to compute unknowns like (k)' and (p)', so that a self-consistent 
condition must be imposed. (In Appendix B, we provide a simpler alternative route to 
these ps.) The result are just functions of {Ni,Ne), with no free htting parameters! 
They turn out to be truncated Poisson distributions: 


Pi{k) 


Zj{NE-k)V 


Ce{p) 


mi 


Ni-p 


Ze{N,-p)\ 


( 10 ) 


which respect PHS manifestly. Here, the Zs are the normalization factors and ( is the 
MFA ‘hole’ distribution of the extroverts (i.e., if we denote the degree of an E by q, 
then its degree distribution is given by (g) = (e {Ni — p))- Plotting these predictions 
with Monte Carlo data from very long runs with various N = 200 systems, we hnd that 
they are statistically indistinguishable for all systems im except the critical case (where 
they fail badly). Though we expect MFA mean held approximations to be good only 
‘far from criticality,’ we were surprised by the excellent overall agreement here. Indeed, 
in an effort to get closer to criticality, we study a much larger system N (3200) with a 
much smaller h (1/1600). In Fig. |^we see that, while pE shows discernible deviations 
from data, pi remains a ‘perfect ht’ down to the level of 10“^! 

To summarize, the XIE model, despite its minimal nature, displays intriguing and 
rich phenomena. The presence of an extreme Thouless effect, i.e.. 


m (h) = sign [h) (11) 

in the N ^ oo limit, suggested by these studies, will be proved in the next section. 
Meanwhile, a dynamic MFA for the degree distributions appears to work quite well 
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Figure 5. The degree distributions for an introvert in a small, critical system: 
Nj = Ne = 20. The MFA prediction is shown as a thin black line. The data are 
shown as solid red circles. 

for off-critical {h ^ 0) systems, even for systems as large as N = 3200. On the other 
hand, it performs quite poorly for the critical case, even for a small system like (20, 20) 
(Fig. §, providing hints that the real distributions are much broader than expected. 
On the other hand, by symmetry, {X) = M/2 at criticality and so, m (h = 0) = 0. 
Thus, our MFA predictions for m {h) are in excellent agreement with all our simulations 
so far. Clearly, there are many interesting issue of hnite-size effects, e.g., how does 
m {h, N) — sign (h) vanish with 1/N7 

Before turning to such recent developments, let us highlight the crucial role of our 
specihc dynamics in producing all the interesting phenomena observed, by studying 
the same model with a seemingly the same, yet slightly different, set of rules. We 
should emphasize that all our dynamic networks are defined by the rules, as opposed to 
imposing detailed balance with respect to a given Hamiltonian (in order to arrive at the 
associated Boltzmann distribution). Therefore, even if two sets of rules appear similar 
and satisfy the Kolmogorov criterion, the steady state can be quite distinct. 

To illustrate this important connection is part of the motivation for studying this 
variant of the XIE. Denoted by XIE^i and named the ‘blind’ XIE, this model 
consists of agents whose actions are blind to the existing state of the links. Thus, 
when an I is chosen to act, it randomly chooses an E hrst and then makes sure there 
is no link (regardless of whether there was one or not). Similarly, an E will choose 
a random I and ensures that a link is present. Though this dynamics is seemingly 
the same, its consequences on the system are profoundly different. Also known as 
the ‘heat-bath’ dynamics in the context of Ising simulations, these rules assigns a new 
conhguration with probabilities independent of the previous N. As a result, V* is trivially 
Hjj {Njd (jiij) -b Ne^ {uij, 1)) /N and corresponds to non-interacting Ising spins in an 
external held. In this case, the equation of state is exactly m = h, with neither phase 
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3. New analytical results in the large N limit of the XIE model 


Though it is clear that the MFA for p are quite adequate for the Ns we explored so 
far, two questions stand out. Why is MFA so good? Is the N ^ oo limit analytically 
accessible? In this section, we provide some answers. Before turning to the details, 
let us begin with some general observations which facilitate the analysis of the large N 
limit, as well as forming an intuitive picture of the system’s unusual behavior. 

As shown above, the standard XIE model displays a sharp transition when Nj 
crosses Ne- With finite N, this critical point can not be approached closer than 
1/N. This disadvantage can be remedied by introducing a continuous, fugacity-like 
variable ; 2 . It represents a bias in favor of the extroverts (each selected with probability 
zj {Nj + zNe) to add a link) and plays the role for generating all moments of X. Thus, 
we consider 

X Ne 

( 12 ) 

2 i=i j=i 


where 


N 


i j 


(13) 


Of course, we have the Hamiltonian "H (z) = — {Ej ln(A:i!) + Sj ln(pj!) + In zSjjnjj}. 
Note that ^ does not add new physics to the XIE model, in the sense that the essence 
of our system’s behavior can be studied by varying just the numbers of each subgroup. 
By extending parameter space to {z, Ne, Nj), we will find that, in the N ^ oo limit. 


a = zNe/Nj 


(14) 


becomes the key control variable, with etc = 1 being the critical point. 

We observe that the lowest value of energy scales as N'^ In N for N ^ oo with a 
fixed. This is stronger than the quadratic dependence on the number of agents! Such 
non-linear increase of ‘energy’ with system size reflects the fact that, in the stationary 
state, some configurations may occur with very low probability. Examples of this 
behavior in previously studied models include the so-called ABC model |2l] and the 
Oslo rice-pile model |25]. This non-extensivity of the ‘energy’ causes no real problems 
in our model, as all ensemble averages are well-behaved in the large N limit. Since the 
number of configurations only increases as the ‘entropy term’ in the effective free 

energy scales as Thus, in the large N limit, the behavior of the system is dominated 
by the energy term. Since the empty or the complete (bipartite) graph has the lowest 
energy (depending on a), we have a good intuitive picture for the emergence of the 
extreme Thouless effect, namely, the fraction {X) /A/" jumping from 0 to 1 as a crosses 
unity. This observation also naturally lead to consider variational and perturbative 
approaches. 
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Even for non-extensive systems, the variational principle of minimizing free energy 
allows us to find the best choice of parameters in a trial probability measure for 
approximating the true V*. Consider a trial state Sx in which all (^) configurations 
with exactly X links are equally likely. Then, the restricted partition function of the 
system, fl(X), satisfies 

ltiSl(.Y)>ln(^^) (15) 

where, in the last term, the average is over the trial state. Away from criticality, the 
distributions of ki and qj are sharply peaked around their mean values and we can use 
Stirling approximation for ln(fc!) = kink, a slowly varying function of k. Then, the 
terms involving InX cancel and the final result is a simple linear function of X, with 
coefficient In a. Apart from z, this alternative approach reproduces the linear term in 
the mean field free energy in [TB] and so, also predicts an extreme Thouless effect with 
ac = 1 . 

3.1. Effective Hamiltonian for introvert dominated systems (a < 1) 

Although our system displays two phases, they are related by PHS. Without loss of 
generality and for ease of presentation, we restrict our discussion to the low density 
phase. Here, the typical degrees of both agents should be small compared to N. Then, 
it is convenient to rewrite H {z) as 

Ni Ne 

^ log {Ni - qj)\ (16) 

i=l j=l 

(where qj is the degree of extrovert j), as we seek limits of {k,q) /N —)■ 0. Now, there 
are many ways to approach such a limit, e.g., (1 — a) oc (or simply A oc 

for z = 1). For the case 0 = 1 (fixed a < 1), we can show that the results obtained 
through MFA above are exact in this limit and offer systematic corrections through a 
perturbative approach. We also find a scaling representation of the degree distribution 
in the 0 = 1/2 case, as well as some aspects of the critical a = 1 system. 

While our conclusions should be valid for all 0 G [1/2,1], the analysis of the 0 < 1/2 
regime remains challenging. In particular, the 0 = 0 case (e.g., even A, A = 2, .^ = 1) is 
of special interest: Starting with a large and equal numbers of introverts and extroverts, 
the expected fraction of cross links is 1/2. How can letting a single agent change sides 
have such a dramatic effect on this fraction (e.g., 0.14 in the 101 Is vs. 99 A’s case)? 
Also, will the observed power law (1 — |m|) ~ for 100 < A < 3000 eventually 

cross over to 1/3? or 1/2? or perhaps some irrational value? Certainly, to understand 
the quantitative aspects this behavior will not be trivial. 

3.1.1. Large A limit with fixed a < 1 First, note that this condition corresponds to 
fixed ratios Ne/Nj or A/A with z = 1 (parameters used in all simulation data here). 
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Here, we expect k,q = 0(1) and x = 0{1/N), so that we can exploit the following 
approximation for terms in the second snm in (16). Writing 


Nil _ Nf 
{N,-q)< ~ F(q;N,) 


(17) 


where 

F{i; M) 

and F(0; M) = 1, we hnd 


n 


1 



£ > 0 


(18) 


lnF(£; M) = -^In 


r=l 


1 - 


r — 1 

~w~ 


2M 


+ 


(19) 


for large M and ^ M. Given lnF{q] Nj) = O (1/iV), a natural perturbative approach 
emerges: 

n {z) = Ho + Hint (20) 

where 


«o = -E 


ln(/ci!) + ki[\n — 


-NeIiiNjI 


and 




( 21 ) 


( 22 ) 


We coined the term ‘interaction Hamiltonian’ for (22) since, under Ho, our system 
reduces, if it were absent, to a collection of non-interacting ks. Then, the summation 
over the conhguration of links attached to different introverts can be carried out 
independently. As there are ways to assign k links to a given introvert, it is 

easy to obtain, e.g., the associated partition function: 


n„ = (Af,!)"'M«' 


(23) 


with 

= (24) 

k 

Since F —>■ 1 for large N, we hnd ojq ^ 1/{1 — a). Identifying uq as the partition sum 
over a single introvert, we arrive at its degree distribution 

P/,0 (k) —)■ (1 — a)a^ (25) 

and the average {k)^ = a/ {1 — a) (which is just Ne/A when = 1). Here, the subscript 
0 indicate averages with 

Turning to the extroverts’ distribution, we note that the number of connections 
qj of extrovert j is a sum of Nj independent contributions. Any particular introvert 
will be connected to the given agent is 0{1/Ne). Hence, it follows that the degree 
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distribution of an extrovert is a Poisson distribution. The mean {q)^ is clearly fixed by 
{(l)o^E = {^)o ~ when 2 ; = 1 ), so that we hnd 


Pe.o (?) ^ e 9 ! 


(26) 


where 7 = {q)^. As expected, these results are identical to appropriate limits of (10). For 
example, fp)' = Nj — {q) —>■ Nj and {Ne — k)\ ^ N^/N\ so that pi —)■ {N/Ni) {Ne/Nj)^. 
While the unihed description for a finite system is a truncated Poisson distribution, we 
see that, in this thermodynamic limit (0 = 1 ), pi and pE approaches, respectively, an 
exponential a pure Poisson. In Appendix C, we highlight the key ingredients behind the 
emergence of these very different limits. 

3.1.2. Scaling regime near criticality: (1 — a) cx While the analysis above allows 

us to approach the critical point as long as A^ 3> (1 — ck)”^, here we present a scaling 
study, valid beyond this regime. Noting that Nj^e = N/2 here, it is convenient to dehne 
the scaling variables 

r = (- In a) k = k/N^^ (27) 


From Eq. (24), we see that 


P /,0 (k) oc 


a 


(28) 


F(t, Ne) 

Instead of the limit Ne 00 , k = O {1) above, we study ks ranging up to O 
here. Using Eq. (19), we hnd 


F{k]NE) = eyrpfik’^/2 Ne) = exp(P^/ 2 ) 


(29) 


and, writing = e we obtain pi Q cx exp —rk — k^ 12 [> to leading order. Thus, we 
arrive at the scaling form 


Pifi (k\a,N,) ~ N,'-F<^ [k,T 


(30) 


where <F(a;, r) = exp(—rx — /2). While extensive simulations are yet to be performed 

in this scaling regime, this prediction is in reasonably good agreement with existing data 
for {Ni,Ne) = (110,90). 

Meanwhile, for the (1601,1599) case shown in Fig. we see that pi (k) increases 


by an order of magnitude before decreasing monotonically. As the scaling form (30) 


does not increase with k (since r > 0 ), this behavior hints at the range of validity of 
this scaling regime. If we rely on the MFA in the previous section, then Eqn. (§ gives 
an implicit condition for monotonicity: Ne < {p)'. Using the results from Appendix B, 
the conclusion is entirely consistent with the assumptions for this regime, namely, that 
this form cannot describe the data when 1 — a drops below \J1/Ne. 
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3.2. Contributions from T-iint 


With this understanding of the unperturbed system, let us turn to the perturbation. We 
will show that these contributions are not only small, but also vanishes with 1/N. Unlike 
the MFA above, this machinery here allows a systematic study, so that corrections for 
both the 0 = 1 and 1/2 regimes can be computed. A detailed study is beyond the scope 
of this work; only highlights will be reported here. 


From Eqns. (22) and (19), we see that 

1 


nj ^ 


2Nr 




(IjiQj - 1 ) 


(31) 


While this varies from one conhguration to another, its fluctuations are quite limited. 
Since each term in is of order 1/A^, the total sum is only 0{1). This could be 
compared to I-Lq, which diverges as N‘^ In N. In fact, the situation is even better. This is 
a sum of many small terms, and different qj that appear in the sum are weakly correlated 
random variables. Such a sum has even smaller fluctuations. Here, each term is of order 
1/N and its fluctuation is also 0{1/N). Thus, the sum is 0{1) while the associated 
variance, {'Hint)o ~ {'hLint)o , is of 0{1/N). This analysis show that, for large N, the 
effects of the perturbation become negligible. Of course, this argument breaks down 
precisely at the critical point, where the correlations between different qjs are no longer 
small. These considerations provide the insight into why the simulation data are so well 
captured by the MFA sketched in the previous section. 


3.3. Plateau of P {X) at criticality and its edges 


Finally, we turn to the extraordinary fluctuations in the critical system. For simplicity, 
we focus on z = 1 and dehne L = Nj = Ne. There is a simple way to understand 
the broad and flat plateau in P {X) and the random walk nature of X [t). Consider 
the ‘motion’ from a given X: It will increase by unity if an E is chosen and it is not 
connected to all Is. Similarly, it will decrease when a partially connected I is chosen. 
Otherwise, it does not ‘move.’ Since the probabilities for choosing either agent is 1/2, 
the probabilities for X to change or not are simply [1 — (e (0|W)] /2, [1 — pi (0|X)] /2, 
and [(/e (0|W) + pj (0|X)] /2. Here, \X means ‘given the number of cross links is X.’ 
Now, the average degree of any individual is just X/L. For large N and X far from 
either 0 or (0|X), p/(0|X) = 0 is a good approximation, so that X performs 

an unbiased random walk to X ± 1. However, if X wanders near one of its boundaries 
(0, L^), then pi (0|X) or (/e (0|X) can be non-trivial, so that X is biased to move towards 
the center. This argument can be sharpened to locate the ‘edge’ of the plateau. 

Suppose X ~ From the expression for partition function wq, putting 

a = 1, we get for the unperturbed Hamiltonian pi {k) oc L!/ [(L — k)\L^uo\ oc F{k) ~ 
exp(—/c(/c — 1)/2L) . Normalizing, we have 


Pi{k) 



k{k-l) 


r\j 


2L 


(32) 
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This function is approximately constant for k -C \/T, and decreases quickly for larger 
k . Thus, the probability that fc = 0 is of order when k < In terms of the 

motion of the random walker, when X is of order each introvert agent has only 

connections on the average and there is a significant probability that a chosen 
introvert has no contacts. Then X will not decrease. Thus, for X < the walker feels 
a net bias, of O , towards larger X. In this sense, the motion can be interpreted 

as a particle in a potential well which is nearly flat in the range ^ X < 

(c being a constant of order 1) and an approximately constant bias of when 

X < This picture is consistent with the preliminary studies [26] of how the ‘left 

edge of the plateau,’ Xedge varies with L. There, the effective exponent is also decreasing, 
so that Xedge L for L = 1778. As in the previous paragraphs, we believe that hnite 
size corrections are non-trivial, even when L ~ 2000. As a result, we may need to run 
with much larger systems to check if the exponent does converge to its asymptotic value 
1 / 2 . 

4. Variants of XIE with preferential attachment 

In the XIE model, an introvert chooses a random link to cut, while in the Bhnd-X/i7, 
it chooses a random partner (and cuts the link if present). Many of us are more selective 
when we face choices. Thus, we consider two other variants, modelling more discerning 
human behavior. Again, for simplicity, we introduce extreme versions to study, in this 
case, with preferential attachment and detachment. As may be expected, dramatically 
different phenomena emerge. Unlike the models above, the dynamics of these XIE 
variants do not satisfy detailed balance. As a result, we have no explicit V*s or effective 
Us. Nevertheless, we use simple arguments concerning the likelihood of the agents’ 
actions and their effects on the collective behavior, often arriving at good predictions 
for systems. Let us hrst specify the models and then discuss their remarkable properties. 

Egalitarian agents (the XIEegai model) : Consider an extrovert and its actions. 
Instead of randomly choosing an introvert (who is not already connected to it) to add 
a link, it finds the least connected introvert to do so. This rule models an agent who 
realizes that the introverts regard links as burden, and attempts to distribute this burden 
as evenly as possible. Alternately, if we associate links with wealth, then this agent’s 
behavior can be thought of as giving wealth (links) to the least fortunate. Thus, we 
coin the term ‘egalitarian’ agent. Similarly, an introvert would cut a link to the most 
connected extrovert, as this action would make the other extroverts more equal. Note 
that PHS is still respected, since the rules in that language can be stated simply as 
follows. An I chooses the E with maximal number of ‘particles’ to cut a link while an 
E chooses an I with the maximal number of ‘holes’ to add one. Finally, in case more 
than one partner satisfy the condition for adding or cutting, then, our agent chooses 
one of those at random. 

Elitist agents (the XIEeut model) : Here, we consider the opposite extreme. In 
this case, an extrovert prefers the most ‘sociable’ introvert, and adds a link to the most 
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connected of the available introverts. In this sense, these agents award the wealthy, 
mnch like gronpies flocking to the most popnlar star. Similarly, an introvert cnts a link 
to the least connected available extrovert. Since all agents keep the nnmber of highly 
connected individnals (the elite) as large as possible, we named them ‘elitists’. Again, 
PHS is respected, as we can replace the word ‘maximal’ above by ‘minimal’ here. 

Of conrse, we can study models where the introverts and extroverts are selective 
in different ways, e.g., egalitarian J’s and elitist EA. But, to focus our investigation 
here, we will only consider the two cases above. Since these has PHS, we need to run 
simulation for only system with, e.g., Nj < Ne, to compile data for both phases. 

Focusing on steady states, and to facilitate comparisons with previous data, we 
study various systems with N = 200 and z = 1. All networks (apart from some 
exceptions) have been initialized randomly and run for 10® sweeps After discarding 
10® sweeps, measurements on an agent of each community are taken after each sweep 
to compile the degree distributions. Working with systems where {Nj, Ne) = (50,150), 
(90,110), (99,101), and (100,100), we measure degree distributions of both the J’s and 
the EA. From these, we extract information relevant for both phases (using PHS). For 
convenience and clarity, we show the data for only pj in a series that runs from (150, 50) 
to (50,150), through the critical point. Plotted in Figs. |^an d0 we see clearly the effects 
of preferential attachment on the sharpness of the transition. For XIEegai, it is even 
sharper; for XIEeiu, the transition is smooth. To form a more complete picture, we 
output typical conhgurations. These reveal that, despite very similar (time averaged) 
degree distributions in critical cases, the systems display drastically different behavior 
(at any given time). Below we present the results, as well as our understanding, for each 
variant. 


4-1. Steady state behavior for egalitarians 


In the low density regime of this XIE^gai model, there are only a small number of 
contacts. Since an extrovert has much bigger choice than an introvert, the steady state 
properties are determined by the behavior of the EA. Suppose we initialize the system 
with all links absent. As extroverts add links and the fraction of introverts with a link 
rises, no link will be added to J’s with /c > 0, as long as there are some J’s with no 
connections. The fraction of J’s with k = 1 continues to increase till it reaches a value 
(a = Ne/Nj) when the rates for adding and cutting are balanced. Thus, in the steady 
state, we have 

P/(0) = 1 - a; pi{l) = a. (33) 

As a increases, the fraction of isolated introverts decrease, so that, when a rare 
fluctuation brings it to zero, the extroverts will create J’s with 2 links. In other words, 
this group of introverts will only occur when extroverts are chosen much more often to 


+ 

* 


With N attempts to update in a ‘sweep,’ each link has an even chance to change in a sweep. 
For example, see Figs. 10 and 15 below. 
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Figure 6. Degree distribution of the introverts for various XIEegai systems with 200 
egalitarians: {Ni,Ne) = (50,150), (90,110), (99,101), (100,100), (101,99), (110,90), 
and (150,50). To facilitate comparisons, we plot an appropriately scaled distribution, 
pNe, against k/NE S [0,1]. Apart from the critical case, all distributions are confined 
to one or the other extreme. 



k/N^ 

E 


Figure 7. Degree distribution of the introverts for various XIEeut systems with 200 
elitists: {Ni,Ne) = (50,150), (90,110), (99,101), (100,100), (101,99), (110,90), and 
(150, 50). To facilitate comparisons, we plot an appropriately scaled distribution, pNe, 
against k/NE G [0,1]. Note that the plateau sections in the critical and the two nearby 
cases are too close to be easily distinguished here. 






















Networks with preferred degree: A mini-review and some new results 


23 


update. We thus estimate that, for fixed a < 1 and large N, pi{k > 2) decreases as 
O where 6 a —)■ 0 as a —)■ 1. 

Turning to the extroverts, their degree distribution is less sharp and can be 
obtained, again through another rate balance equation. For simplicity, let us fix 
z = 1. With degree q, there are q/N chances for one of its / contact to be chosen, 
leading to a drop in q. Since it will, when chosen, definitely increase q, we are led to 
(q/N) Pe {q) = (1/iV) (g — 1) and the prediction 

Pe {q) = 1/eg! (34) 


A similar argument can be made for P{X). If X < Nj, introverts tend to have only 
one link or none. So, there are X/N ways to pick a connected /, who will cut its 
link. Yet, every choice of an E leads to an increase in X, so that the rate balance 
equation reads {X/N) P (X) = {Ne/N) P (X — 1). The result is a Poisson distribution 
P (X) oc N§/X\, exact in the X —)■ cx) with fixed a. For systems with finite (X/, Ne), 
it is possible for X to exceed Nj when a is close to unity. At the other extreme, for 
X 3 > X/, every choice of / will decrease X . Thus, balancing the rates leads us to a 
simple exponential, P (X) oc , in this regime. A unified way to regard these regimes 
is that, as X increases, the ratio P (X — 1) /P (X) crosses over, from X/Ne to Nj/Ne- 
The detailed nature of this cross-over may be quite complex, but this general picture 
is borne out well in all our data (not shown). Finally, we may estimate the range of 
(X/, Ne) in which the Poisson distribution should hold. Since the width of the Poisson 
distribution is of order a/X^, it should be valid as long as 1 — a < (P (l/i/X^). Thus, it 
is exact in the X —)■ cx) with fixed a. For the high density phase («>!), invoking PHS 
leads to similar conclusions, namely, Pe{Ni) = 1 — and Pe{Ni — 1) = ■ Also, 

away from criticality, the variance in the degree distribution is only O ( 1 ). As a result, 
the transition becomes much sharper than the proto XIE model. Finally, the critical 
case will be discussed extensively below, as it exhibits the most interesting behavior. 

From Fig. we see various aspects of the expected, the most prominent being 
distributions confined to one of the two extremes when Nj ^ Ne- At the more 
detailed level, the predictions (33) is in perfect agreement with the (150,50) data: 
Pi (0) = 0.6667025 and pi (1) = 0.3332975. Meanwhile, though p/ (0) = 1 — a is very 
well satisfied for all low density cases, the data shows a detectable spread beyond k = 1 
(except for the (150, 50) case). For the near critical system, (101,99), two features in pj 
are noteworthy. For fc > 2, it drops exponentially. With an extremely well fit to 
it behooves us to conjecture p/ oc e~^^. Before this decay, pi rises substantially, from 
0.198 (= 2/101) to 0.473 and 0.427 for A: = 1 and 2 , respectively. A good explanation 
for this behavior is yet to be advanced. By contrast, the distributions for the extroverts, 
Pe (g), in this regime (related, through PHS, to p/ in the high density phase shown in 
Fig[^ fit well to the prediction above, l/egi, as shown in Fig[^ 

Let us turn to the data for the distributions P (X) away from criticality. Fig 
shows that our prediction agrees with the (150, 50) case perfectly. It is clear that the 
next case (110, 90) is displaying cross-over behavior, as the Poisson distribution provides 



Networks with preferred degree: A mini-review and some new results 


24 



Figure 8. Degree distributions for egalitarian extroverts, pE (q), far in the low density 
phase. 



Figure 9. Distributions for X in two low density XIE^gai systems: (150, 50) (red 
circles) and (110,90) (red squares). Appropriate Poisson distributions are shown as 
black lines. The dashed blue line is the exponential, (9/11)"'^, provided as a guide to 
the eye. 

a reasonable fit only for X < 110 = Nj. Beyond that, P decays asymptotically into an 
exponential. To guide the eye, we plotted as a dashed line (with a = 90/110 here). 
The validity of this cross-over scenario persists (not shown here) to the near critical case 
(101,99), in which (99/101)^ provides an excellent £t in a wide range of X (from ~ 150 
to the maximum accessible by our computers, ~ 900). To summarize the off-critical 
data in this variant, we conclude that the extreme Thouless effect is even stronger, as 
m {h, N) — sign (h) appears to vanish as e~^ for any h ^ 0. 

The critical case {Ni = Ne = L) is the most fascinating. In Fig. we see that pi 
is statistically flat across the entire range, except for dips at both ends. This behavior 
might be expected from the phrase we coined, ‘egalitarian,’ but such a completely 
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flat distribution does not reveal the typical configurations as the system evolves. In 
particular, under the egalitarian dynamics, an agent with degree k will not get an 
added link, if there is just a single agent with degree k — 1. Thus, at any particular 
time t, most agents are expected to have degrees in a narrow range, say ±1, around 
some value, A (t). In this sense, the egalitarian agents, acting together, do achieve their 
aim of minimizing within population variations. However, since there is no bias in favor 
of either group, we expect that A {t) should perform an unbiased random walk, within 
[0,L^], over long times. This phenomenon is confirmed by simulations, as discussed 
next. 

To pre-empt possible critical slowing down, we carry out very long runs (5 x 10^ 
sweeps) with a smaller system: (60,60). Initializing the incidence matrix to be a fully 
occupied upper triangle (not significant here, but more so below), we output N’s at 10^ 


(s = 0,...,5) sweeps. These are shown in Fig. 10 (from the top left; a black/white 
square represents a present/absent link). While every sample appears disordered, note 
how the total X differs considerably from one s to the next. In Fig. we show the time 
traces of the degrees of two introverts and two extroverts (after the system is relaxed 
2 X 10^ sweeps). The four traces are almost indistinguishable, as expected. Over time, 
they perform the same random walk, over the entire available range. To quantify such 
behavior, we may define the average degree at any instant t, by 


\{t)=X (t) jL 


(36) 


where X is of course the same as Sj/cj of the introverts and of the extroverts, as 
well as and two variances 


Di (t) = -De (i) = / E''I - 


(36) 


On the one hand, we expect Di^E{t) to vary little in time and remain O (1) (even at 
this critical point). Thus, the time averaged DA will also be 0{1). In stark contrast, 
A {t) performs the same random walk as X (t). Thus, the time averaged distribution is 
flat over most of the full range [0, L] (in Fig. [^, leading to a variance of O (T^). Far 
from the extremes, X changes by ±1 at each attempt with equal probability and so, 
the time scale for traversing is (9 (L^) sweeps (O (L‘^} attempts). This estimate is 


entirely consistent with the traces in Fig. 11 To summarize, a simple picture emerges 
for the critical dynamics. At short time scales, the egalitarian practice of agents ensures 
a sharply peaked distribution, with each agent having only one link more than, or 
less than, some value A. Over longer periods, A wanders, as X/L arrives close to an 
integer. Further studies should provide a more detailed and quantitative picture of the 
remarkable collective behavior of such a minimal model. 
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Figure 10. Evolution of typical incidence matrices for a (60,60) system of 
egalitarians. The initial configuration is fully ordered, with links above the diagonal. 
A snapshot is taken after 10^ sweeps. The panels here, from the left, are snapshots 
at s = 0,1,..., 5. In each snapshot shown, the degree of every agent is essentially the 
same: 30, 27, 26,44, 7, and 34, respectively. 





Figure 11. Time trace of the degrees of two introvert egalitarians, k (black, blue), 
and of two extroverts, q (red, green) in a critical (100,100) system. Here the unit of t 
is a sweep. Note the typical time for traversing the full range is O (L^) sweeps. It is 
difficult to resolve the 4 traces, even when a small portion is magnified (Fig. 12). 


4-2. Steady state properties for elitists 

Turning to the XIEeut model, we again consider the low density phase hrst. Starting 
from a random distribution of introvert degrees, an interesting instability should set in. 
The introvert with the largest degree will be selected for attachment as soon as any 
extrovert (not already linked to it) is chosen to act. Since its k can decrease only when 
it is selected, its degree is likely to rise rapidly. Of course, k cannot rise beyond Ne, and 
the extroverts will pick the next ‘star’ for attachment. This instability will continue until 
the steady state, in which the rate of links being added equals the rate for deletion. In a 
low density phase, the probability that an extrovert is fully connected vanishes for large 
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Figure 12. An expanded region of Fig. 11 


Symbols are the same here. 


N, so that it can always add a link if selected. Thns, the rate for adding links is jnst 
Ne/N. Bnt the rate for deletion is proportional to the fraction of introverts with one or 
more links. Balancing the above rate with this, [1 — pj (0)] Nj/N, we hnd the fraction of 
isolated introverts to be 1 — a, an exact resnlt for large N. Making a similar argnment 
for the high density phase, we expect a smooth cross-over, with no discontinnities, as a 
is varied throngh nnity. Simnlations confirm this pictnre. Yet, the degree distribntions 
display nnexpected nniqne properties, as illnstrated in Fig. For the introverts, we 
see that the data in the first two cases for p/(0), 0.667436 and 0.182119, agree with 
the predicted valne 1 — a to 0.2% . Meanwhile, the rest of the introverts appears to be 
connected in an nnnsnal way, with pi {k) distribnted evenly, np to almost the maximnm 
Ne- At hrst sight, a flat p reminds ns of the critical egalitarian case. However, snch 
a platean can be realised in another manner. In the next paragraphs, we will show 
a remarkable nnderlying strnctnre, not easily discernible by examining the incidence 
matrix, N. 

Consider a typical confignration for the (150, 50) case, illnstrated by N on the 
left in Fig. (again, black and white entries represent present and absent links, 
respectively). The links appear scattered thronghont the matrix. However, considerable 
order is revealed if we ‘sort’ the agents as follows. On the right of Fig. IB, we show 
the same N, with the rows and colnmns permnted into an ordered list, in which the 
most connected introvert (extrovert) is placed on the top row (right colnmn). To avoid 
confnsion, we nse red (sqnares for a link) for snch ‘sorted’ N’s. While indeed, 2/3 (i.e., 
1 — Ne/Nj) of the rows are empty, the remaining connected agents arrange themselves 
in an orderly fashion. To gnide the eye, we shaded this region (50 x 50) yellow and 
ronghly, an npper triangnlar matrix emerges here. Clearly, a strictly ordered L x L 
matrix of this type will prodnce a completely flat distribntion; p{k) ~ 1/L. The insight 
gained here allows ns to interpret the rest of the distribntions in Fig. When the 

agents are sorted, the N’s will progress, as schematically sketched in Fig. from the 
(150,50) rectangle on the left, throngh the (100,100) sqnare, to the (50,150) rectangle 
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on the right. The best summary of such behavior is: All agents in the minority will 
partner with a similar number of those in the majority, creating a triangular incidence 
matrix (after sorting), while the rest of the majority are static and content (with all 
links or none). Of course, each individual changes partners often, but the sorted network 
displays little variation. Given this picture, it is easy to see that (X) varies continuously 
through criticality. Indeed, we can easily predict the fraction (x), using this area of red 
region (jA^; — A/| + {Ne — A/)^ /2), and arrive at an equation of state: 


m {h) = 


2h 


(37) 


1 + \h\ 

While the singularity is undoubtedly smoothed out in hnite systems, this result is most 
likely exact in the A —)• cx) limit. This formula certainly captured the essence of the 
model: It predicts 0.0198, 0.1818, 0.6667 for the three non-critical low density systems 
here, while the observed values are 0.0207, 0.1819, and 0.6662, respectively. Though the 
plateau and triangular N’s are the most prominent features, there are other noteworthy 
details in Fig. [^ : Both the dips at the ends of each plateau and the non-monotonic 
behavior in pi {k ~ 0) for the Nj > Ne systems are intriguing. Clearly, there is ample 
room for theoretical explanations. 

Though the degree distributions are not expected to show ‘large fluctuations,’ the 
typical Ns (e.g., left panel in Fig. 13 ) raise a different question, concerning the nature 


of disorder. For simplicity, let us explore the time evolution of the critical case, where 
all but a small fraction of agents should be ‘active’. Expecting the conhguration shown 
in the schematic sketch, we start with an ordered state = 1 and 0 otherwise; 

fully occupied upper triangle in a 60 x 60 square). As above, we output an N after 10^ 
sweeps, for s = 0,..., 5. In Figj^we see that, even after a single sweep (upper left panel), 
signihcant ‘disorder’ already appears. Though disorder seems to increase steadily, we 
hnd that the sorted N remains approximately the same throughout the evolution. As an 
example, we show in Fig 16 the conhguration at the last time (top central panel) along 
with its sorted version (top right panel). Indeed, it is straightforward to show that, if 
we resort the agents after each update, it is not possible for an introvert to create a 
0 (cut a link) in the sea of Is, or for an extrovert to create a 1 in the domain of Os. 
Thus, the staircase like interface between the two domains will be preserved at each 
step and our XIEeut can be mapped into a 1-dimensional interface, starting at the top 
left corner of the square and ending at the lower right. The conhgurations are readily 
labeled by a string of L vertical and L horizontal steps, e.g., VHHVVVVHVH.... With 
this mapping, we see that the rules of evolution are simple: Choose a step (an element 
of the string) at random and exchange the hrst unlike pair to its right. For example, if 
the third V is chosen, the new string is VHHVVVHVVH.... We see that the unlike 
pairs are exchanged with varying rates that depend on the length of the domain to the 
left. This mapping also reduces the number of conhgurations considerably, from 2^^ for 
all possible Ns to just . 

Turning to non-critical cases, we see that the relevant strings consist of A/ Ns and 
Ne As, so that we have a total of conhgurations. As a result of the dynamics. 
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Figure 13. Typical snapshot of an incidence matrix for a {Nj,Ne) = (150,50) 
XIEeiit system in the steady state (left). The sorted N is shown in red (right). The 
yellow region is a 50 x 50 square, as a guide to the eye. The green border serves to 
indicate the extent of the matrix. 



Figure 14. Schematic of typical steady state configurations (incidence matrices) in 
the XIEgiit model - after sorting. In all cases, there are Nj rows and Ne columns. 
The red (white) region denotes the presence (absence) of a link. The rectangle on 
the left (right) represents the case of Nj = 150 (50) and Ne = 50 (150). The square 
represents the critical system: Nj = Ne = 100. 
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Figure 15. Evolution of typical incidence matrices for a (60,60) system of elitists 
(the XIEeiit model). The initial configuration is fully ordered, with links above the 
diagonal. A snapshot is taken after 10® sweeps. The panels here, from top left, are 
snapshots at s = 0,1,...,5. When sorted, all of them resemble closely the initial 
configuration. See Fig. 16 for an example (s = 5) of the sorted matrix. 


there is a high probability that the strings end with a domain of the majority, of length 
~ \Nj — Ne\- For example, in the (150,50) case (Fig. 13), we will hnd that most of 
the activity takes place within the hrst 50 + 50 elements of the string, leaving ~ 100 Ids 
essentially static. Of course, the active part of the string here corresponds to the yellow 
region in the right panel of Fig. 

Despite the signihcant reduction of conhgurations (from 2^^^® to and 

simplihcation of the rules, the dynamics for this interface model does not satisfy detailed 
balance, so that hnding the stationary distribution of this interface will be challenging. 
Nevertheless, by considering equivalent classes of Ns (from sorting) in the XIEeiit model, 
this mapping should be a promising approach for a better understanding of the behavior 
of our network of elitist introverts and extroverts. 

To end this section, let us highlight the dramatically different behaviors between the 
two variants when Nj = Ne- In the central panels FigjTBI we show the last conhgurations 
(after 10® sweeps) of both systems, starting from the same initial N (top left panel). 
After sorting, these matrices take the widely disparate forms shown in the right panels 
(in red). Meanwhile the time-averaged degree distributions of both are, apart from 
minor differences at the two extremes, practically identical (lower left panel)! The time 
traces of four specihc agents also reveals the major differences. Illustrated in Fig. 12 


is a small portion of Fig. 11, where we see that indeed, the egalitarian agents have 
essentially the same degree. A, at any time, but that A wanders over the full range. 


By contrast. Fig. IT and a magnihed portion. Fig. clearly show that these elitist 
agents have wildly differing degrees in general, but each agent’s degree wanders over the 
full range. In the society of ‘elitists,’ the inequality at any time is quite extreme. Yet, 
over time, any particular individual experiences both extreme ‘affluence’ and ‘poverty.’ 
The time averaged ‘wealth’ of all individuals is the same, and in this sense, symmetry 
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Figure 16. Incidence matrices, initially (top left) and after 10® sweeps (center). The 
latter, when sorted, are shown in red (right). Top/bottom row: elitists/egalitarians. 
Both stationary degree distributions are shown in the lower left panel. 



t 


Figure 17. Time trace of the degrees of two introvert elitists, k (black, blue), and of 
two extroverts, q (red, green) in a critical (100,100) system. Note the four traces are 
very different, unlike the egalitarians case. 


is restored as all agents must be equal on the average. Similar to the egalitarian case, 
there is little variation in a different, more subtle, aspect here. When ranked by the 
number of connections, these individuals fall into the same order. In other words, at 
any time, a specihc permutation (vr) of the agents will expose an ordered state, but it is 
TT that wanders over long periods. There are clearly substantial correlations between all 
agents in both cases. These fascinating aspects should provide much food for thought 
and many avenues for future explorations. 

5. Summary and Outlook 

In the first part of this article, we provided a brief review of networks with preferred 
degrees, designed to model a natural social behavior: An individual tends to reduce 
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Figure 18. An expanded region of Fig. The four traces are easily resolved here, 
showing very different trajectories. 


or increase its number of contacts if it finds there are too many or too few. In our 
baseline model, we assign a fixed preferred number n to each agent and it cuts/adds a 
random link if its degree k is more/less than k. The system evolves stochastically as 
a random agent is chosen to to act in each attempt. Despite the apparent randomness 
of such a network, the degree distributions display non-trivial properties. Partly due to 
the detailed balance violating aspect of its dynamics, the stationary state distribution 
{V* (A), of the set of networks or adjacency matrices. A) is not known. Though it is 
very challenging to predict averages of observables, some approximation schemes are 
able to capture the essence of some quantities, e.g., the degree distribution. Even more 
surprising behavior emerges when we study a population with just two communities 
{GIE models), differing by the numbers of individuals and their k’s. These puzzles led 
us to consider an extreme limit, the XIE model, with k = 0 and oo . Remarkably, 
detailed balance is restored here, leading to an exact expression for V* (A). The system 
evolves towards ‘thermal equilibrium’ with an effective Hamiltonian —InP*, though 
there is no obvious control parameter corresponding to temperature. In addition, we 
identihed an underlying symmetry, similar to that in the Ising model. Despite such 
progress, it is not feasible to compute, without judicious approximations, the averages 
of typical interesting quantities analytically. Through simulations with iV’s up to 3200, 
we discover an unusual transition, when Ne/Nj crosses unity. Specihcally, the network 
is essentially empty (full) when Ne/Nj < 1 (> 1). At the critical point, the value of 
X wanders over almost the entire range [0,7V], so that a broad flat plateau appears 
in the time averaged distribution, P{X). Furthermore, unlike in typical hrst order 
transitions, there is no hysteresis or metastability when Ne — Nj suddenly change 
signs. This astonishing phenomenon, considered an extreme version da [20] of the 
Thouless effect, is far from common in typical statistical systems, the behavior of which 
generally fall into the Ehrenfest classihcation scheme of (hrst, second, ... order) phase 
transitions. Focusing on the degree distribution of a single agent, we advance mean held 












Networks with preferred degree: A mini-review and some new results 


33 


arguments for their transition probabilities and obtain analytic predictions. Away from 
the transition, they are in excellent agreement with simulation data. At criticality, giant 
fluctuations render such approaches ineffective, while few of the system’s properties are 
quantitatively understood. 

In the rest of this article, we present new results on the XIE model and its novel 
variants. In the large N limit, we hnd that the agents of the majority subgroup are 
effectively independent. Using both variational and perturbative techniques, we gain 
valuable insight into why the mean held approach is so reliable and hnd a scaling theory 
of huctuations near the transition. Lastly, we introduce two other variants, the XIE^gai 
and XIEeiit models, in which the agents show preferential attachment/detachment. In 
XIEegai, instead of choosing a random introvert to connect, an ‘egalitarian’ extrovert 
adds a link to the least connected /. Similarly, an I cuts a link to the most connected 
E. At the opposite extreme is XIEeiu, in which an extrovert ‘elitist’ agents adds its 
link to the most connected /, etc., modelling those who chase after celebrities. Not 
surprisingly, while the egalitarian system leads to a more severe form of the extreme 
Thouless ehect, the transition for the elitists is continuous. Simulations with relatively 
small systems show refreshingly novel behavior, especially for the elitists. Though these 
dynamics violate detailed balance and no exact V*A are available, we are able to exploit 
previously used techniques to obtain good predictions far from criticality. A complete 
and quantitative understanding remains to be established. 

It is clear that our pursuits raise many interesting questions worthy of future 
research. We list only a few here. As pointed out in previous studies [ini E], 
investigating other properties in the XIE system is clearly a goal within grasp, notably, 
a systematic study of hnite size scaling will also help to shed light on such peculiarities 
of this model. Though of purely theoretical interest, we may treat H as a genuine 
Hamiltonian of the Ising type and introduce (inverse) temperature /3 and magnetic held 
B (i.e., —Inz above) into a Boltzmann factor 

V <xexp{-^[H- BX]} (38) 

The advantage of such a system is that we can study off-critical behavior not only in the 
odd-variable 5, but also in a standard, even-variable /3. Properties in an extended phase 
diagram (as T-H for the Ising model) should shed light on the original XIE model. 
Finite size scaling studies can follow standard routes, so that we can follow simple 
ways to access critical exponents and scaling functions. In parallel, renormalization 
group analysis 120 ] should be performed and the results compared. In this language, 
we can gain considerable insight into this system by studying hxed points and their 
neighborhoods. It will be very interesting to determine if there are relevant operators 
other than fl and B. Finally, identifying the irrelevant variables will let us delineate 
clearly the universality class of this B. 

Beyond the XIE, its variants and other systems with two communities, we should 
explore more realistic populations in which a wide distribution of k’s is present. Will 
some of the peculiarities presented above vanish? or will we face further surprises? Other 
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variants concern a tendency to favor adding connections to, instead of the celebrity of 
the time, ‘friends of friends.’ Correlations will surely build up, while the notion of 
communities will emerge in a self-organized manner. Another front involves assigning 
weights to the links - to model the natural tendency for us to have a few close friends 
along with many acquaintances [27]. It is easy to devise various quantitative measures 
of closeness, e.g., how many minutes per day do two individuals converse. Directed 
links with weights can also be introduced - to account for a speaker’s interactions with 
a large audience, or the frequency A calls Z vs. Z calling A. Having such weights allows 
us to impose carrying capacities (e.g., 24 hours per day) in social networks. In this 
manner, the portrait of one’s friendship is not restricted to the number of connections: 
Celebrities may boast 10,000 ‘friends,’ but they cannot converse meaningfully with each 
one daily! Needless to say, as we build more realism and complexity into the models, 
we should be prepared to face mounting challenges. 

Finally, let us emphasize that we focused here only on the topology and dynamics 
of the network between individuals with hxed ks. The next natural step is to take 
into account different states (a) an agent may hnd itself, e.g., health, wealth, opinion, 
etc. Indeed, we can expect an agent’s k to depend on not only its a but also those of 
others, as illustrated by the example with epidemics in the Introduction. Beyond social 
networks, there is considerable interest the behavior of all types of interacting natural 
and artihcial networks, e.g., ocean currents and marine food-webs [7], the internet and 
the power grid, etc. Such pursuits should be instrumental as we proceed to the ambitious 
goal of understanding adaptive, co-evolving, interdependent networks in general. 
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Appendix A. Tutorial, using an explicitly solvable case 

For sufficiently small systems, it is possible to hnd the stationary distribution and 
currents by brute force. This section serves as a tutorial for how the system can be 
analysed at the most basic level. 

The smallest population displaying non-trivial behavior consists of four nodes, with 
K = 2 (i.e., nodes with 2 or 3 links will cut and those with 0 or 1 link will add). To 


Networks with preferred degree: A mini-review and some new results 


35 


visualize the graphs, place the nodes on the corners of a square, so they can be connected 
via its edges and diagonals. There are 6 links {Ai^j = 1 or 0) and so, the conhguration 
space consists of 64 points: {A 12 , A 13 , Ai 4 ^, ^ 23 , A 24 , A 34 }. 

To find V*, we exploit both symmetry and inaccessibility. The latter accounts for 
the lack of transitions to the null or complete graphs, so that we have 

P*(0,0,...,0)=iP*(l,l,...,l)=0 (A.l) 


which reduces the number of unknown V*A to 62. There are two symmetries, one being 
permutation. The other is ‘particle-hole’ symmetry, specific to this N, k combination. 
Its consequence is that complimentary graphs share the same V*. As a result, there 
are just 5 independent "P^’s. Denoted by pa (a = 1,...,5) they correspond to e.g., 
P*( 1 , 0 ,..., 0 ), P*( 1 , 1 ,..., 0 ), P* ( 1 , 0 , .., 0 , 1 ), P* ( 1 , 0 , 0 , 1 , 0 , 1 ), and P* ( 1 , 1 , 1 , 0 , 0 , 0 ), 


respectively. 

To account for the symmetries, we introduce Qi for their degeneracies. As an 
example. 


P3 = P*(1,0,0,0,0,1)=P* (0,1, 0,0,1,0) 
= V* (0,1,1,1,1,0)=P*(1,0,1,1,0,1) 


V* (0,0,1,1, 0,0) 

P* (1,1, 0,0,1,1). 


(A. 2 ) 

(A.3) 


implies that = 6 . To be clear, we write 


= 6 + 6 ,12 + 12, 3 + 3,4 + 4,12 


(A.4) 


where the -|- notation reminds us of the contribution from complimentary graphs. In the 
last group , the complimentary graph of any member is also in the group. The last entry 
(12) contains graphs Note that these add up to 62. They serve in the normalization 
condition 

^ = '^ 9 aPa (A.5) 

a 

and to check probability conservation in a ‘reduced master equation’ for the p’s. Though 
symmetries help in reducing the number of unknowns, such a set of 5 equations must 
be derived from considering ([^ for specific configurations. For example, we have 

P*( 1 , 0 ,..., 0 ) = V(0,0,...,0)+ (A. 6 ) 

6 

1 

+ 8 

leading to pi = ^p 2 . Similar equations for the other 4 p’s can be derived, and we arrive 
at the ‘reduced master equation’ 


V* (1,1, 0, 0, 0, 0) + V* (1, 0,1, 0, 0, 0) + 
+V* (1, 0, 0,1, 0, 0) + V* (1, 0, 0, 0,1, 0) 


^ Pi ^ 


/ 0 1/2 0 0 0 \ 


Pi ^ 

P2 


5/12 0 0 1/3 1/4 


P2 

P3 

= 

1/3 0 0 0 1 


P3 

P4 


0 10 0 0 


Pi 

\P5 ) 


0 5/6 1/2 0 0 y 


\Ps ) 


(A. 8 ) 
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Since the normalization condition (A.5) is 


1 = 12pi + 24p2 + 6p3 + 8p4 + 12p5 


(A.9) 


the check for probability conservation can be posed as: Is (12,24,6,8,12) a left 
eigenvector with nnit eigenvalne for the above matrix? The answer is indeed “Yes.” 
Meanwhile, the associated right eigenvector provides ns with P 2 = Pi = ‘2pi,P3 = 4pi, 


and p 5 = llpi/3. Imposing (A.5), we hnd 

Pi = 1/144 


(A. 10) 


which completes the fnll stationary distribntion. 

From this explicit solntion, we can compnte, e.g., the (average) degree distribntion, 
p ik). Exploiting symmetry, we can focus on node 1, say, and study only p (0) and p (1). 
Formally, we write 

P (^) = ^ {Ai 2 + Ai 3 + Ai4 — k) V*{h) (A.11) 

{A} 

So, 

p(0) = 3pi + 3p2+P4= ^ = p(3) (A. 12 ) 

A shortcut, namely, {k) = 1, can be used to obtain p (1) = 61/144 = p (2). To check 
this result, we verify that p (1) = 3pi + (6 + 3) p 2 + 3 p 3 + 3 p 4 + 6 p 5 is indeed 61/144. 

Finally, it is easy to check that detailed balance is violated. For example, the 
rate-product is clearly positive for the ‘elementary loop’ involving graphs of types 
1—)-3—)-5—)-2—)■!. Yet, the product for the reversed loop vanishes, as the rate 
for 3 —)■ 1 is zero. The Kolmogorov criterion is not satished, so that the system will 
settle into a non-equilibrium stationary state, with non-trivial stationary probability 
currents and loops [2H] (much like those in a steady state electric circuit). The net 
current, /C*, from A to A', can be seen from Eq. ([^ 

/C*(A ^ A') = R{K A')P*(A) - R{M K)V*{M) (A. 13) 

The simplest example, since 3 —1 is zero, is fC* = pi /6 = 1/864, for A = (1,0, ..,0) 
and A' = (1, 0,.., 0,1). It is instructive to study loops as well. From this A', we can only 
transition to one of 4 graphs of the form A" = (1,1, 0, 0, 0,1), and then returning to A 
via A'" = (1,1, 0,0, 0, 0). These three /C’s are, respectively, ps/d — ps/d = 1/1728, 
P 5/8 — 5p2/24 = 1/3456, and P 2/8 — 5pi/24 = 1/3456. As in circuit analysis, 
there is an instructive alternative, using loop currents, I, instead. For example, 
X*(A —)■ A'—)■ A"—)■ A'" —)■ A') is just /C*(A —)■ A')/4 = 1/3456, since there are four such 
loops associated with the A —)■ A' segment. A good exercise is to draw the entire network 
of conhgurations and determine all the loop currents. 
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Appendix B. Simple, alternative method for determining p 
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Conceptually, it is straightforward that a self consistency condition must be imposed 
in the MFA for ppE'- The input parameters of each are inextricably linked with the 
output values of the other. There is a simpler approach, by considering the probability 
for A —)• A ± 1 This condition can also be derived from since the averages of each must 
satisfy 

Nj {k) = {X) = Ne {q) (B.l) 

Now, (k) can be found from 

Ne Ne n : , 


NE-{k) = J2(NE-k)p,(k) = Y, 


k=0 


i=0 


m 

Zril 


= {pYi^-pi 


But, 


So, 


Ni 


Nr 


{pY = (p) / 


(p) 


p=i 


p=i 


1 - Cb (0) 


Ni {k) =Ni(Ne- (p) 


giving us 


1-P/ (0) 
-1 - Ce ( 0 ) 
= Ne (q) = Ne {Nj - {p)) 


Ni[1-pi{0)] = Ne 1 - 4 ( 0 ) 


(B.2) 

(B.3) 

(B.4) 

(B.5) 

(B.6) 

(B.7) 


Note the PHS is manifest here, as well as being automatically satished for the critical 
case. However, for say. A/ > Ne, we expect (e (0) to be extremely small and so, arrive 
at 

Pi (0) = ^ (B.8) 


namely, Eq. (33). Exploiting this and the normalization conditions, we can End fp)' via 

NeNe 




(pY {pY {pY 


+ .u = i 


(B.9) 


This equation can be written in closed form with the help of the exponential sum 
function, e„ (^) = or an incomplete T function, but it is simpler to determine 


(p)' numerically using (B.9). For specihc cases, we have checked that this approach 
indeed produces (e (0) 1, which justifies the use of (B.8). 


Appendix C. Truncated Poisson distribution 


In this appendix, we provide details of our distributions (10). In the literature (e.g., 
, this kind of truncation is known as Type 1. We also dealt with {•)', which comes 
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under the heading of Type 3 truncated Poisson distributions. Defined on £ G [0,n] 
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en (0^! 


(C.l) 


is proportional to the standard Poisson distribution within its support. In the limit of 
n — ?• oo with fixed T reduces trivially to the Poisson: e~^f^/i\. However, if both f 
and n — >■ cx) , with fixed f/n = fi>l, then it is clear that T increases monotonically in 
[0, n]. Since T peaks at £ = n, it is natural to use the variable i = n — i and to study 


T{i;^,n) = 


e 


n—l 


en (0 


in the regime of £ ~ O (1). Exploiting (17 19), we arrive at the exponential 


T oc p ^ 


(C.2) 


(C.3) 
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